Explainability in Data Science: Interpretability, Reproducibility, and Replicability

Replicability is not Reproducibility: Nor is it Good Science

At various machine learning conferences, at various times, there have been discussions arising from the inability to replicate the experimental results published in a paper. There seems to be a wide spread view that we need to do something to address this problem, as it is essential to the advancement of our field. The most compelling argument would seem to be that reproducibility of experiment...

Replicability and Reproducibility in Comparative Psychology

Psychology faces a replication crisis. The Reproducibility Project: Psychology sought to replicate the effects of 100 psychology studies. Though 97% of the original studies produced statistically significant results, only 36% of the replication studies did so (Open Science Collaboration, 2015). This inability to replicate previously published results, however, is not limited to psychology (Ioan...

Advancing Science with VGI: Reproducibility and Replicability of Recent Studies using VGI

Reproducibility and replicability of rodent phenotyping in preclinical studies

The scientific community is increasingly concerned with the proportion of published "discoveries" that are not replicated in subsequent studies. The field of rodent behavioral phenotyping was one of the first to raise this concern, and to relate it to other methodological issues: the complex interaction between genotype and environment; the definitions of behavioral constructs; and the use of l...

Experimenter gender and replicability in science

There is a replication crisis spreading through the annals of scientific inquiry. Although some work has been carried out to uncover the roots of this issue, much remains unanswered. With this in mind, this paper investigates how the gender of the experimenter may affect experimental findings. Clinical trials are regularly carried out without any report of the experimenter's gender and with dub...